5 research outputs found
Integrating Knowledge Graph embedding and pretrained Language Models in Hypercomplex Spaces
Knowledge Graphs, such as Wikidata, comprise structural and textual knowledge
in order to represent knowledge. For each of the two modalities dedicated
approaches for graph embedding and language models learn patterns that allow
for predicting novel structural knowledge. Few approaches have integrated
learning and inference with both modalities and these existing ones could only
partially exploit the interaction of structural and textual knowledge. In our
approach, we build on existing strong representations of single modalities and
we use hypercomplex algebra to represent both, (i), single-modality embedding
as well as, (ii), the interaction between different modalities and their
complementary means of knowledge representation. More specifically, we suggest
Dihedron and Quaternion representations of 4D hypercomplex numbers to integrate
four modalities namely structural knowledge graph embedding, word-level
representations (e.g.\ Word2vec, Fasttext), sentence-level representations
(Sentence transformer), and document-level representations (sentence
transformer, Doc2vec). Our unified vector representation scores the
plausibility of labelled edges via Hamilton and Dihedron products, thus
modeling pairwise interactions between different modalities. Extensive
experimental evaluation on standard benchmark datasets shows the superiority of
our two new models using abundant textual information besides sparse structural
knowledge to enhance performance in link prediction tasks.Comment: ISWC2023 versio
Interaction with a Virtual Coach for Active and Healthy Ageing
International audienceSince life expectancy has increased significantly over the past century, society is being forced to discover innovative ways to support active aging and elderly care. The e-VITA project, which receives funding from both the European Union and Japan, is built on a cutting edge method of virtual coaching that focuses on the key areas of active and healthy aging. The requirements for the virtual coach were ascertained through a process of participatory design in workshops, focus groups, and living laboratories in Germany, France, Italy, and Japan. Several use cases were then chosen for development utilising the open-source Rasa framework. The system uses common representations such as Knowledge Bases and Knowledge Graphs to enable the integration of context, subject expertise, and multimodal data, and is available in English, German, French, Italian, and Japanese
Knowledge graph embeddings using neural itĂ´ process: from multiple walks to stochastic trajectories
[2]M. Nayyeri, B. Xiong, M. Mohammadi, M. M. Akter, M. M. Alam, J. Lehmann ~. . In